Hybrid-image display device

ABSTRACT

According to an implementation of the present specification there is provided an apparatus for creating a hybrid image. The apparatus comprises: a first light source configured to emit a first light in a first direction; a reflector disposed to intercept the first light and configured to at least partially reflect the first light in an output direction to produce a reflected first light. The apparatus also comprises a second light source configured to emit a second light, the reflector configured to at least partially transmit the second light in the output direction to produce a transmitted second light. The apparatus also comprises an input terminal configured to receive an input used to control one or more of the first light source and the second light source. The hybrid image comprises a combination of the reflected first light and the transmitted second light.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority from U.S. Provisional PatentApplication No. 62/167,113 filed on May 27, 2015, which is incorporatedherein by reference in its entirety.

FIELD

The present specification relates to interactive hybrid-image displaydevices and methods, and more particularly to retail marketinginteractive hybrid-image display devices and methods.

BACKGROUND

Generally retail customers want to visually examine and interact with aproduct before making the decision to purchase that product. However,conventional retail presentation of products has several limitationsthat restrict the ability of a customer to examine and interact with aproduct. First, the limited shelf space in a store presents a physicallimit to the number of products that can be conveniently presented tothe customer. Second, when a visual representation of a product ispresented on a paper flyer or a conventional in-store screen, thesevisual representations often lack sufficient detail and do not allow thecustomer to interact with and examine the product through its visualrepresentation. Third, product packaging, especially packaging intendedto be tamper-proof or to protect the integrity of products, can presenta further obstacle to potential customers' ability to examine andinteract with the product.

SUMMARY

According to an implementation of the present specification there isprovided an apparatus for creating a hybrid image. The apparatuscomprises: a first light source configured to emit a first light in afirst direction; a reflector disposed to intercept the first light, thereflector configured to at least partially reflect the first light in anoutput direction to produce a reflected first light; a second lightsource configured to emit a second light, the reflector configured to atleast partially transmit the second light in the output direction toproduce a transmitted second light; and an input terminal configured toreceive an input used to control one or more of the first light sourceand the second light source. The hybrid image comprises a combination ofthe reflected first light and the transmitted second light.

The input terminal can comprise a control screen configured to display auser interface; and the input can comprise a touch input receivedthrough the user interface.

The second light source can comprise a first portion of a displaydisposed on a side of the reflector opposite the output direction, thefirst portion covered by the reflector; and the control screen cancomprise a second portion of the display, the second portion extendingbeyond a perimeter of the reflector thereby allowing the second portionto receive the touch input unobstructed by the reflector.

The user interface can comprise one or more dynamic input zonesconfigured to receive the touch input, receiving the touch inputtriggering changes in an appearance of at least one of the input zones.

The reflector can be disposed at about 45° to the first direction.

The apparatus can further comprise one or more of a motion sensor and aproximity sensor configured to sense motion and proximity respectivelyin the vicinity of the apparatus.

The second light source can comprise a display oriented about parallelto the reflector.

The apparatus can further comprise: a first surface disposed at a firstangle to the reflector, the first surface disposed on a side of thereflector opposite the output direction; and a first surface lightsource configured to illuminate at least a portion of the first surface.

The apparatus can further comprise: a second surface disposed at asecond angle to the reflector, the second surface disposed on the sideof the reflector opposite the output direction, the second angledifferent from the first angle; and a second surface light sourceconfigured to illuminate at least a portion of the second surface.

At least one portion of one or more of the first surface and the secondsurface can be at least partially translucent to human-visible light,the at least one portion configured to be backlit by its correspondingone of the first surface light source and the second surface lightsource.

One or more of the first surface and the second surface can comprise oneor more of a fabric and an acrylic material.

One or more of the first surface light source and the second surfacelight source can be controlled by the input.

The hybrid image can comprise the combination of the reflected firstlight and the transmitted second light combined with one or more of afirst surface light emanating from the first surface and a secondsurface light emanating from the second surface.

The apparatus can further comprise a sound emitter controlled by theinput.

The apparatus can further comprise an output terminal configured toconnect to auxiliary sources of one or more of light, sound, smell,physical movement, and materials, the auxiliary sources external to theapparatus, the output terminal configured to allow the input to controlone or more of the auxiliary sources.

The apparatus can further comprise one or more of a payment informationreader and an identification information reader configured to readpayment information and identification information respectively andcontrol one or more of the first light source and the second lightsource based on one or more of the payment information and theidentification information.

According to another implementation of the present specification thereis provided a method of creating a hybrid image, the method comprising:receiving an input at an input terminal; controlling one or more of afirst light source emitting a first light and a second light sourceemitting a second light based on the input; producing a reflected firstlight by at least partially reflecting the first light from a reflector;producing a transmitted second light by at least partially transmittingthe second light through the reflector; and creating the hybrid imagecomprising a combination of the reflected first light and thetransmitted second light.

The input terminal can comprise a control screen; and the receiving theinput can comprise displaying a user interface on the control screen;and receiving a touch input at the control screen.

The second light source can comprise a first portion of a display andthe control screen can comprise a second portion of the display.

The method can further comprise: displaying one or more dynamic inputzones on the control screen, the dynamic input zones configured toreceive the touch input; and changing an appearance of at least one ofthe input zones in response to the touch input.

The method can further comprise: sensing one or more of motion andproximity in the vicinity of one or more of the first light source, thesecond light source, and the reflector; and controlling one or more ofthe first light source and the second light source based on one or moreof the sensed motion and proximity.

The method can further comprise one or more of: illuminating a firstsurface using a first surface light source, the first surface disposedat a first angle to the reflector; and illuminating a second surfaceusing a second surface light source, the second surface disposed at asecond angle to the reflector, the second angle different from the firstangle. The hybrid image can comprise the combination of the reflectedfirst light and the transmitted second light combined with one or moreof: a first surface light emanating from the first surface andtransmitted through the reflector, and a second surface light emanatingfrom the second surface and transmitted through the reflector.

The method can further comprise controlling one or more of the firstsurface light source and the second surface light source based on theinput.

The method can further comprise producing, using a sound emitter, one ormore sounds based on the input.

The method can further comprise synchronizing with each other two ormore of the first light source, the second light source, the firstsurface light source, the second surface light source, and the soundemitter to produce a hybrid presentation.

One or more of the first light source and the second light source cancomprise a display having a plurality of pixels; and the controlling cancomprise selecting, based on the input, one or more of a given set ofone or more images from a library of sets of images for being displayedby one or more of the first light source and the second light source;and a given number of and given coordinates of the pixels of one or moreof the first light source and the second light source for displaying thegiven set of one or more images.

The method can further comprise controlling, based on the input, one ormore auxiliary sources of one or more of light, sound, smell, physicalmovement, and materials.

BRIEF DESCRIPTION OF THE DRAWINGS

Implementations of the present specification will now be described, byway of example only, with reference to the attached Figures, wherein:

FIG. 1 depicts a top perspective view of an exemplary hybrid-imagedisplay device, according to non-limiting implementations.

FIG. 2 depicts a schematic, side elevation, cross-section of a portionof the device of FIG. 1.

FIG. 3 depicts a side elevation view of the device of FIG. 1, with aselection of internal components shown in dashed lines.

FIG. 4 depicts a front elevation view of the device of FIG. 1, with aselection of internal components shown in dashed lines.

FIG. 5 depicts a rear elevation view of the device of FIG. 1, with arear outer panel of the device removed to reveal some internalcomponents. FIG. 5 also shows a selection of otherwise obscured otherinternal components, shown in dashed lines.

FIG. 6 depicts a top perspective view of another exemplary hybrid-imagedisplay device, according to non-limiting implementations.

FIG. 7 depicts a side view of the device of FIG. 6.

FIG. 8 depicts a front view of the device of FIG. 6.

FIG. 9 depicts a bottom rear perspective view of the device of FIG. 6.

FIG. 10 depicts a top perspective view of another exemplary hybrid-imagedisplay device, according to non-limiting implementations.

FIG. 11 depicts a flow chart showing steps of a method of creating ahybrid image, according to non-limiting implementations.

DETAILED DESCRIPTION

The present specification discloses a display device capable of formingan interactive, hybrid image which can include, but is not limited to,an interactive hybrid image of an object or a product. This displaydevice can allow a large number of products to be presented to potentialcustomers without the need for additional retail shelf space for eachadditional product. This hybrid image can produce in a viewer theperception that the hybrid image has depth and/or is three-dimensional(3D). Moreover, since the 3D image is interactive, the potentialcustomer can manipulate the image and examine the visual details of theproduct from multiple perspectives unhindered by any product packaging.The present specification also discloses a method of forming suchinteractive 3D hybrid images.

FIG. 1 shows an exemplary hybrid-image display device 100 comprising ahousing 105 which supports a first display 110, a reflector 115, and asecond display 120. First display 110 and/or second display 120 cancomprise LCD, LED, OLED, plasma, or any other suitable type of display.Reflector 115 is disposed at an acute angle to first display 110. Seconddisplay 120 is disposed on the side of reflector 115 opposite the sideclosest to first display 110. Reflector 115 partially overlaps seconddisplay 120 such that a first portion 125 of display 120 is covered byreflector 115. A second portion 130 of display 120 extends beyond aperimeter of reflector 115, and as such is not covered or obstructed byreflector 115. As will be described in greater detail below, reflector115 reflects at least a portion of a light emitted by first display 110and transmits at least a portion of the light emitted by first portion125 of second display 120. The combination and/or layering of thereflected light and the transmitted light forms a hybrid image which canappear to the viewer as having depth and/or being 3D. Second portion 130of display 120 can be used as a control screen to display a userinterface and to receive touch input from a user/viewer. Hereafter,“user” and “viewer” are used interchangeably. The touch input can beused to control first display 110 and/or second display 120, therebycontrolling the hybrid image and allowing the user to manipulate thehybrid image. This, in turn, can allow a user to interact with thehybrid image.

Device 100 can further comprise optional sensors to sense its externalenvironment, including the presence of a user. For example, device 100can comprise proximity sensors 135 to detect whether a user is nearby.In addition and/or instead, device 100 can comprise motion sensors 140to detect movement in its proximity. One or a combination of thesesensors can be used by device 100 to detect a user and to produce aresponse. For example, the response can comprise turning on or waking updevice 100 to capture the attention of a nearby user for potentialretail marketing purposes.

Device 100 can also comprise an optional magnetic card reader 145 thatcan be used to read information from cards including, but not limitedto, identification, loyalty, rewards, gift, and/or payment cards. Insome implementations, card reader 145 can also write information backonto these cards. This information can also be used to control one ormore of the first display 110 and the second display 120, in order tocontrol the hybrid image.

Device 100 can also comprise one or more optional openings 150 in one ormore of its side panels. Openings 150 can allow for air circulation intoand out of housing 105 to cool the electronic components inside housing105. In addition, openings 150 can allow sound generated by any speakersinside housing 105 to more easily exit housing 105.

FIG. 2 shows in cross-section a schematic drawing of a portion of device100, and depicts the light rays that can form the hybrid image. Firstdisplay 110 emits light X in the first direction 205. Light X propagatestowards reflector 115, which intercepts light X and at least partiallyreflects light X to form reflected light X′ propagating in an outputdirection 210 and towards viewer 215. First portion 125 of seconddisplay 120 emits light Y, which is at least partially transmitted byreflector 115 to form transmitted light Y′ also propagating in theoutput direction 210 towards viewer 215. The combination and/or layeringof reflected light X′ and transmitted light Y′ forms the hybrid imagewhich can be perceived by viewer 215 as having depth or a 3D quality.

It is contemplated that reflected light X′ can be substantially the sameas light X, except for its direction. It is also contemplated thattransmitted light Y′ can be substantially the same as light Y.

Second portion 130 of display 120 can be used to display a userinterface for receiving input from viewer 215. In addition secondportion 130 of display 120 can be used to act as an input terminal forreceiving a touch input from viewer 215, which touch input can be usedto control one or more of first display 110 and second display 120,thereby controlling and manipulating the hybrid image. The touch inputcan include, but is not limited to, single or multi finger touch,gestures, swipes, force-sensitive touch, and/or single or multi objecttouch such as touch by a stylus or an electronic pen or controller. Thereceiving of touch input can allow viewer 215 to interact with thehybrid image; for example to zoom, rotate, translate, transform,actuate, or activate the object represented in the hybrid image. This inturn can allow viewer 215 to view and/or examine the object representedin the hybrid image from different directions and perspectives, and indifferent states.

Although FIG. 2 shows one output direction 210, viewing angles of device100 are not limited to output direction 210. It is contemplated thatoutput directions can comprise a range of directions away from reflector115 and outwardly of device 100 in which a potential viewer can perceiveat least some of the light from first display 110 as reflected fromreflector 115 and at least some of the light from first portion 125 ofsecond display 120 transmitted through reflector 115.

Optionally, other backlight Z can also be transmitted through reflector115 to form transmitted back light Z′ propagating in the outputdirection 210 towards viewer 215. Transmitted back light Z′ can combinewith reflected light X′ and transmitted light Y′ to contribute to theformation of the hybrid image. It is contemplated that in someimplementations transmitted light Z′ can be substantially the same aslight Z.

Backlight Z can be emitted by any number of suitable sources. Forexample, optionally device 100 can comprise a base 217 disposed on theside of reflector 115 opposite output direction 210 (i.e. the side ofreflector 115 opposite the side closet to first display 110). As shownin FIG. 2, base 217 can be disposed at an acute angle to reflector 115.The angle can be about 45°. Base 217 can define a surface 220 which canbe illuminated by an optional corresponding internal surface lightsource 230. The resulting light emanating from surface 220 can form allor a portion of backlight Z. In addition, optionally, device 100 cancomprise a back 222 disposed on the side of reflector 115 oppositeoutput direction 210. As shown in FIG. 2, back 222 can be disposed at anacute angle to reflector 115. The angle can be about 45°. Back 222 candefine a surface 225 which can be illuminated by a correspondinginternal light source, such as surface light source 230. The resultinglight emanating from surface 225 can also form all or a portion ofbacklight Z. In some implementations, light emitted by surface lightsource 230 itself can directly form all or a portion of backlight Z.

In some implementations, at least a portion of one or more of base 217and back 222 can be at least partially translucent to human-visiblelight and can be backlit by an internal light source located outside ofthe space defined by reflector 115, base 217, and back 222. For example,one or more of base 217 and back 222 can comprise fabric, acrylic, orother suitable materials. While the internal surface light source isshown as being located in one corner of the space defined by reflector115, base 217, and back 222, it is contemplated that surface lightsource 230 can be located in any suitable location in that space.Surface light source 230, and any other similar surface light sources,can also be controlled by the input received from the user at secondportion 130 of second display 120.

In device 100, reflector 115 is disposed at about 45° to first direction205 of light X emitted by first display 110. This angle can reduce strayreflections in device 100. In other implementations, reflector 115 canform an angle with first direction 205 of light X that is between about30° and about 60°. In yet other implementations, reflector 115 can forman angle with first direction 205 of light X that is greater than about60° or less than about 30°. In some implementations, the angle betweenreflector 115 and first direction 205 of light X can be adjustable,which can allow for adjusting optimal viewing directions and the hybridimage.

In device 100, first portion 125 of second display 120 is oriented aboutparallel to reflector 115 to reduce optical artifacts. However, it iscontemplated that first portion 125 can be oriented at any acute angleto reflector 115. In addition, FIG. 2 shows a small gap between firstportion 125 and reflector 115. However, it is contemplated that firstportion 125 can be adjacent to and/or in contact with reflector 115.

Reflector 115 can be shaped as a plate, a sheet, or other opticallysuitable shape. Reflector 115 generally comprises a material that canreflect at least a portion of the light X incident upon it, whiletransmitting at least a portion of the light Y existing on the side ofthe reflector 115 opposite the side receiving the light X. Reflector 115can comprise, but is not limited to, a glass material, a plasticmaterial, a glass composite material, and/or a plastic compositematerial. Reflector 115 can comprise an at least partially transmissiveglass or plastic matrix having embedded within it a set of orientedreflective particles. These reflective particles can comprise metallicflakes. Reflector 115 can comprise Peppers Ghost glass, treated glass,and/or optical hologram film.

FIG. 3 shows a side elevation view of device 100, with a selection ofthe internal components shown in dashed lines. FIG. 3 shows housing 105supporting first display 110, reflector 115, and second display 120.FIG. 3 also shows motion sensor 140, card reader 145, and openings 150of device 100. In addition, FIG. 3 shows base 217 defining surface 220and back 222 defining surface 225.

FIG. 4 shows a front elevation view of device 100, with a selection ofthe internal components shown in dashed lines. FIG. 4 shows housing 105supporting first display 110, reflector 115, and second display 120having a first portion 125 and second portion 130. First portion 125 isshown in dashed lines as it is covered by reflector 115. Base 217defining surface 220 is also depicted. Proximity sensors 135 and motionsensors 140 are also shown secured to an upper portion of housing 105near first display 110. Magnetic card reader 145 is also visible,secured to housing 105 on one side of reflector 115.

FIG. 5 shows a rear elevation view of device 100, with a rear outerpanel removed to reveal a selection of internal components of device100. A selection of other internal components that would otherwise beobscured from view is shown in dashed lines. FIG. 5 shows housing 105supporting first display 110. Internal surface light source 230 issecured to a portion of housing 105, such that internal surface lightsource 230 can illuminate surface 225 defined by back 222 (surface 225and back 222 not visible in FIG. 5, but shown in FIG. 3). An optionalsecond internal surface light source 505 is also secured to housing 105,and can be configured to illuminate surface 220 defined by base 217.Surface light source 230 can also be referred to as “back light” andsurface light source 505 can also be referred to as “stage light”. Insome implementations, one or more of the back light and the stage lightcan be controlled by the input received from the user.

FIG. 5 also shows controllers 510,515 configured to control the imagesdisplayed by first display 110 and second display 120. Controllers510,515 can comprise a memory and processors such as a CentralProcessing Unit and/or a Graphics Processing Unit. In someimplementations, controllers 510,515 can comprise a video decoding unitcapable of decoding two videos simultaneously. Controllers 510,515 canreceive the input from the user (e.g. received at second portion 130 ofsecond display 120) and determine what image or images are to bedisplayed on first display 110 and second display 120. Controllers510,515 can also determine what images are displayed on first portion125 of second display 120 and what user interface is displayed on secondportion 130 of second display 120 (first portion 125 and second portion130 not labeled in FIG. 5, but labeled in FIG. 4), which can also bedetermined based on the input received from the user. Input from theuser is not limited to input received at second portion 130 of seconddisplay 120, and can include, but is not limited to, data receivedthrough barcode scanners, motion sensors, RFID, GPIO and USB buttoncontrols, IR remote controls, serial devices, keyboards and mice.

Controllers 510 and 515 can each control a corresponding one of firstdisplay 110 and second display 120. In some implementations, device 100can comprise only one controller to control all the displays. Whiledevice 100 is shown as having onboard memory and/or processors in theform of controllers 510,515, it is contemplated that device 100 can haveno onboard memory and/or processors, i.e. have no controllers.Alternatively, the memory and/or processors can be integrated into eachcorresponding display; for example, one or more of first display 110 andsecond display 120 can comprise a tablet such as an iPad™.

Device 100 can also comprise an optional GPS locator 520 that can beused to track the location of device 100. If device 100 is implementedas part of a mobile marketing unit, GPS locator 520 can be used totailor or customize based on the location of device 100 the contentdisplayed by one or more of first display 110 and second display 120. Anexample of a mobile marketing unit can comprise, but is not limited to,a truck or other vehicle transporting marketing materials, messages,and/or devices to various locations.

Device 100 can also comprise an optional circuit board and/ormicrocontroller 525 configured to communicate on/off and RGB commands toone or more of first internal surface light source 230 and secondinternal surface light source 505. Microcontroller 525 can receivecommands from one or more of controllers 510,515 and in response sendprogrammed responses to internal surface light sources 230 and 505. Insome implementations, these internal light sources can be controlleddirectly by one or more of controllers 510,515, which can send on/offand other commands directly to internal surface light sources 230 and505.

Device 100 can also comprise one or more optional sound emitters 530,which can comprise, but are not limited to, speakers. Sound emitters 530can be controlled by one or more of controllers 510,515 and can beactivated and/or controlled based on the input from the user. Soundemitters 530 can also be controlled by input from sensors incorporatedin device 100 and/or based on internal programming of controllers510,515. In some implementations, controllers 510,515 can be configuredto synchronize the sound emitted from sound emitters 530 with imagesand/or video displayed by one or more of first display 110 and seconddisplay 120 to create a hybrid audio-visual presentation.

Housing 105 of device 100 can be made of materials comprising metals orany other sufficiently rigid and strong material such as high-strengthplastic, wood, and the like. In some implementations, housing 105 cancomprise one or more panels removably secured to a structural frame.Removable panels can allow for easy access to internal components ofdevice 100 to service and/or exchange those components.

FIG. 6 shows a top perspective view of another implementation ofhybrid-image display device 600, which is generally similar to device100. The differences between device 600 and device 100 are described ingreater detail below. Device 600 comprises a housing 605 supportingfirst display 110, reflector 115, and second display 120. Housing 605comprises a display guard 610 which surrounds the edges of secondportion 130 of second display 120. Display guard 610 can protect seconddisplay 120 from impact by users, shopping carts, and other objects andforces external to device 600. It is also contemplated that displayguard 610 can surround a subset or all of the exposed edges of secondportion 130 of second display 120. Device 600 can also comprise openings650 to facilitate sound generated inside housing 605 to travel outsidehousing 605.

FIG. 7 shows a side view of device 600, showing housing 605 supportingfirst display 110 and comprising display guard 610 and openings 650.

FIG. 8 shows a front view of device 600, showing housing 605 supportingfirst display 110, reflector 115, and second display 120. FIG. 8 alsoshows display guard 610 surrounding and protecting edges of secondportion 130 of second display 120.

FIG. 9 shows a rear, bottom perspective view of device 600, comprisinghousing 605 supporting first display 110 and having openings 650.Housing 605 also comprises openings 955 in a bottom panel of housing 605near edges of second portion 130 of second display 120. Openings 955 canbe configured to facilitate sound to emerge from inside housing 605, andalso to allow air to circulate into and out of housing 605 to cool thecomponents inside housing 605. In addition, housing 605 can compriseopenings 960 in a rear panel of housing 605. Openings 960 can perform afunction similar to openings 955.

FIG. 10 shows a top perspective view of another implementation of thehybrid-image display device 1000. Device 1000 comprises display device100 secured to a stand 1005. Stand 1005 can be of any shape or dimensionso long as stand 1005 can support device 100 at a height at which a usercan view the hybrid image formed by device 100 and can give input todevice 100 and interact with the hybrid image. In other implementations,instead of device 100, device 600 can be secured to stand 1005. In yetother implementations, stand 1005 can have an adjustable height toadjust the level of device 100 or device 600 for the height of eachuser.

While devices 100 and 600 are exemplary implementations of thehybrid-image display device, other variations and implementations arealso possible. For example, and without limiting the possibleimplementations and variations, one or more of the first display and thesecond display can comprise any other suitable light source. Forexample, a light projector can be used instead of a display. In general,the first and second displays can comprise any light source capable ofemitting light and producing an image.

In addition, while in devices 100 and 600 second portion 130 of seconddisplay 120 acts as the input terminal to receive touch input from theuser, it is contemplated that any other type of input terminal can beused. For example, the input terminal can be separate from the firstportion 125 of second display 120, i.e. second display 120 may not havea second portion 130. The input terminal can comprise a keypad, a mouse,a joystick, a pedal, a controller, a touch screen separate from seconddisplay 120, a mobile device, or any other suitable input deviceconfigured to receive input from the user.

In implementations where the input terminal comprises a control screen,the control screen can be configured to display a user interface and toreceive a touch input from the user through the control interface. Theinput interface can be generated and/or controlled by one or more ofcontrollers 510,515. Controllers 510,515 can detect the input from theuser, and in response control one or more of the first and seconddisplays, the first and second internal surface light sources (i.e. theback light and the stage light), and the sound emitter. Controllers510,515 can also change the user interface based on the input from theuser. The user interface can comprise one or more dynamic input zonesconfigured to receive the touch input, where receiving the touch inputcan trigger corresponding changes in an appearance of at least one ofthe input zones. The dynamic input zones can comprise touch zones,whereby touching anywhere in that zone constitutes a given selection bythe user.

In implementations where the input terminal comprises second portion 130of second display 120, second portion 130 extends beyond the perimeterof reflector 115 thereby allowing second portion 130 to receive touchinput unobstructed by reflector 115.

Moreover, while in devices 100 and 600 first portion 125 and secondportion 130 are shown as being two rectangular portions of aboutcomparable size, the respective shapes and relative sizes of the firstand second portions can be different. For example, the boundary betweenthe first and second portions can be sloped, curved, jagged, orotherwise irregularly shaped. In other words, the edge of reflector 115which defines the boundary between first and second portions can beslopped, curved, jagged, or otherwise irregularly shaped. Inimplementations where the second light source and the input terminal arenot portions of the same display, the second light source and the inputterminal and be separated and/or spaced from one another.

In addition, in implementations where the second light source comprisesa display and the input terminal comprises a touch screen, it iscontemplated that the display and the touch screen may not be coplanaror disposed on parallel planes. For example, the angle and orientationof the second display can be selected to optimize forming the hybridimage, whereas the angle and orientation of the touch screen inputterminal can be selected to optimize displaying a user interface to andreceiving touch input from the user.

In device 100 (and also device 600), the projection of reflector 115onto the plane defined by first display 110 can have dimensionscomparable to dimensions of first display 110 and can overlay firstdisplay 110; see FIG. 2. This, in turn, can allow for all orsubstantially all the light emitted by first display 110 in direction205 to be intercepted by reflector 115, and potentially reflected in theoutput direction 210 and useable to generate the hybrid image. Moreover,referring again to FIG. 2, a width of first portion 125 can be aboutcommensurate with width of reflector 115, also to allow for all orsubstantially all of the light emitted by first portion 125 to beincident upon reflector 115, and potentially transmitted in the outputdirection 210 and useable to form the hybrid image. The “width” can bethe dimension in the out-of-page direction, i.e. the directionperpendicular to the direction 205 and to the output direction 210.

In some implementations, the hybrid-image display device can alsocomprise an output terminal configured to connect to auxiliary sourcesof one or more of light, sound, smell, physical movement, and materials.These auxiliary sources can be external to the display device. Theoutput terminal can be configured to allow the input from the userand/or the controllers to control one or more of the auxiliary sources.In this manner, the user can also interact with the environment externalto and/or surrounding the display device. In addition, the sounds andimages produced by the display device can be synchronized with theeffects produced by the auxiliary sources to produce a multi-sensoryeffect on the user.

Moreover, while device 100 is depicted as having magnetic card reader145, in some implementations an RFID and/or chip card reader/writer canbe used in addition and/or instead of magnetic card reader 145. In yetother implementations, a bar code reader can be used in addition and/orinstead of magnetic card reader 145.

In some implementations, the hybrid-image display device can have wiredor wireless data connectivity ability, for example using a network cardin communication with one or more controllers 510,515. Network dataconnectivity can allow the display device to be remotely programmed, forexample by utilizing remote content changeability. In addition, dataconnectivity can allow the display device to communicate and/or pairwith a mobile device of a user in order for the user to control thedisplay device and/or for the display device to display content from theuser's mobile device such as a smartphone and smart wearable device.

In some implementations, controllers 510,515 have stored in their memorya collection of pre-recorded image sets or videos. Based on the input,the controllers can apply their internal programming to determine whichcontent to play, which display(s) to play it on, and over which set ofpixels on each display to play that content. This eliminates the need torender images and/or video on the fly and reduces the computing andpower needs of device 100. This can also increase speed and enhanceresponsiveness of device 100. In other implementations, the controllerscan render video on the fly based on the input from the user.

FIG. 11 shows in a flow chart the steps in an exemplary method 1100 forcreating a hybrid image, such as the hybrid images that can be formed bythe hybrid-image display devices described herein. In step 1105, aninput is received at the input terminal. An exemplary input cancomprise, but is not limited to, input from a user and/or viewer. Instep 1110, based on the input, a first light source emitting a firstlight is controlled and/or a second light source emitting a second lightis controlled. An exemplary first light source can comprise, but is notlimited to, first display 110. An exemplary second light source cancomprise, but is not limited to, first portion 125 of second display120. For example, first light can comprise, but is not limited to, lightX and second light can comprise, but is not limited to, light Y as shownin FIG. 2.

In step 1115, a reflected first light is produced by at least partiallyreflecting the first light from a reflector. For example, the reflectedfirst light can comprise, but is not limited to, light X′. The reflectorcan comprise, but is not limited to, reflector 115. In step 1120, atransmitted second light is produced by at least partially transmittingthe second light through the reflector. For example, the transmittedsecond light can comprise, but is not limited to, light Y′. In step1125, the hybrid image is created comprising a combination and/or alayering of the reflected first light and the transmitted second light.

The input terminal can comprise a control screen and the receiving theinput can comprise displaying a user interface on the control screen andreceiving a touch input at the control screen.

In some implementations, the second light source can comprise a firstportion of a display and the control screen can comprise a secondportion of the same display. For example, as in the case of devices 100and 600, the second light source can comprise first portion 125 ofsecond display 120 and the control screen can comprise second portion130 of second display 120. In some implementations, for example devices100 and 600, first portion 125 and second portion 130 are not separatedisplays, but merely represent different sets of pixels of the samesecond display 120 which sets of pixels perform different functions:first portion 125 functions as the second light source whose light istransmitted through reflector 115 to contribute to forming of the hybridimage, whereas second portion 130 functions to display a user interfaceto the user and to receive touch input through the user interface fromthe user.

In some implementations, method 1100 further comprises displaying one ormore dynamic input zones on the control screen, where the dynamic inputzones are configured to receive the touch input. The input zones arevisual zones which are dynamic in the sense that once a touch input isreceived, the appearance of at least one of the input zones can bechanged in response to the touch input. In a device like device 100,this change of appearance can be performed by one or more of controllers510,515.

In some implementations, method 1100 can further comprise sensing one ormore of motion and proximity in the vicinity of one or more of the firstlight source, the second light source, and the reflector; andcontrolling one or more of the first light source and the second lightsource based on one or more of the sensed motion and proximity. Forexample, in device 100, proximity sensor 135 and motion sensor 140 canbe used to detect user proximity or motion near device 100, and thencommunicate their output to one or more of controllers 510,515, whichcontrollers in turn control first display 110 and second display 120 tochange one or more of the hybrid image and the user interface.

Method 1100 can also comprise one or more of: illuminating a firstsurface using a first surface light source, the first surface disposedat a first angle to the reflector, and illuminating a second surfaceusing a second surface light source, the second surface disposed at asecond angle to the reflector, the second angle different from the firstangle. In the non-limiting example of device 100, the first surface cancomprise surface 220, the first surface light can comprise internalsurface light source 505, the second surface can comprise surface 225,and the second surface light can comprise internal surface light source230. The hybrid image can comprise the combination and/or layering ofthe reflected first light and the transmitted second light combinedand/or layered with one or more of a first surface light emanating fromthe first surface and transmitted through the reflector, and a secondsurface light emanating from the second surface and transmitted throughthe reflector. In the non-limiting example of device 100, light Z′ canrepresent one or more of a first surface light emanating from the firstsurface and transmitted through the reflector, and a second surfacelight emanating from the second surface and transmitted through thereflector.

In some implementations, these first and second surface light sourcescan be controlled by the input from the user. For example, in thenon-limiting case of device 100, the input can be communicated to one ormore of controllers 510,515 which can in turn control one or more ofinternal surface light sources 230 and 505.

The method can further comprise using a sound emitter to produce one ormore sounds based on the input. In the non-limiting example of device100, the sound emitter can comprise sound emitter 530.

In some implementations, the method can further comprise synchronizingwith each other two or more of the first light source, the second lightsource, the first surface light source, the second surface light source,and the sound emitter to produce a hybrid presentation. This hybridpresentation can comprise a hybrid audio-visual presentation.

In some implementations, one or more of the first light source and thesecond light source comprises a display having a plurality of pixels.Non-limiting examples include LCD, LED, OLED, and plasma displays whichcomprise addressable pixels. Step 1110 can comprise selecting, based onthe input a given set of one or more images from a library of sets ofimages for being displayed by one or more of the first light source andthe second light source. In addition and/or in the alternative, step1110 can comprise selecting, based on the input, a given number of andgiven coordinates of the pixels of one or more of the first light sourceand the second light source for displaying the given set of one or moreimages.

For example, based on the input, one or more of controllers 510,515 canselect an image or a set of images (e.g. in the form of video) todisplay on one or more of first display 110 and second display 120. Thecontrollers can also decide which subset of pixels (i.e. number andcoordinate of pixels) should be used to display that content. Thecontent can be selected from a library of pre-recorded or pre-renderedimages and videos to reduce the computation and power needs ofimplementing this step and to enhance responsiveness.

Method 1100 can further comprise controlling, based on the input, one ormore auxiliary sources of one or more of light, sound, smell, physicalmovement, and materials.

The methods described herein, including method 1100, are not limited tobeing performed on any of the devices described herein. The steps ofthese methods are described in reference to components of devices 100and 600 for demonstrative purposes only. These methods can be performedusing any suitable components and apparatuses.

The devices and method of the present specification can allow a user tointeract and engage with a hybrid image having a 3D appearance. Thehybrid image can allow the user to visually inspect various aspects ofthe objects represented in the hybrid image and to receive additionalinformation about those objects that would not be readily available froma 2D image or video. Such interactive, 3D hybrid images can produce inthe user a perception of tactile interaction with an object, as the useris able to manipulate a 3D representation of the object using touchinput.

In the retail marketing context, the devices and methods of the presentspecification can enable merchants to attract and educate the consumerthrough a new marketing platform that allows for a higher profile withinthe retail environment and for interaction between the consumer and the(representations of) their products without the need for the physicalproducts being present.

The above-described implementations are intended to be examples of thepresent invention and alterations and modifications may be effectedthereto, by those of skill in the art, without departing from the scopeof the invention which is defined solely by the claims appended hereto.

1. (canceled)
 2. (canceled)
 3. An apparatus for creating a hybrid image,the apparatus comprising: a first light source configured to emit afirst light in a first direction; a reflector disposed to intercept thefirst light, the reflector configured to at least partially reflect thefirst light in an output direction to produce a reflected first light; asecond light source configured to emit a second light, the reflectorconfigured to at least partially transmit the second light in the outputdirection to produce a transmitted second light; and an input terminalconfigured to receive an input used to control one or more of the firstlight source and the second light source; wherein: the hybrid imagecomprises a combination of the reflected first light and the transmittedsecond light; the input terminal comprises a control screen configuredto display a user interface; the input comprises a touch input receivedthrough the user interface; the second light source comprises a firstportion of a display disposed on a side of the reflector opposite theoutput direction, the first portion covered by the reflector; and thecontrol screen comprises a second portion of the display, the secondportion extending beyond a perimeter of the reflector thereby allowingthe second portion to receive the touch input unobstructed by thereflector.
 4. The apparatus of claim 3, wherein the user interfacecomprises one or more dynamic input zones configured to receive thetouch input, receiving the touch input triggering changes in anappearance of at least one of the input zones.
 5. The apparatus of claim3, wherein the reflector is disposed at about 45° to the firstdirection.
 6. The apparatus of claim 3, further comprising one or moreof a motion sensor and a proximity sensor configured to sense motion andproximity respectively in the vicinity of the apparatus.
 7. Theapparatus of claim 3, wherein the second light source comprises adisplay oriented about parallel to the reflector.
 8. The apparatus ofclaim 3, further comprising: a first surface disposed at a first angleto the reflector, the first surface disposed on a side of the reflectoropposite the output direction; and a first surface light sourceconfigured to illuminate at least a portion of the first surface.
 9. Theapparatus of claim 8, further comprising: a second surface disposed at asecond angle to the reflector, the second surface disposed on the sideof the reflector opposite the output direction, the second angledifferent from the first angle; and a second surface light sourceconfigured to illuminate at least a portion of the second surface. 10.The apparatus of claim 9, wherein at least one portion of one or more ofthe first surface and the second surface is at least partiallytranslucent to human-visible light, the at least one portion configuredto be backlit by its corresponding one of the first surface light sourceand the second surface light source.
 11. The apparatus of claim 9,wherein one or more of the first surface and the second surfacecomprises one or more of a fabric and an acrylic material.
 12. Theapparatus of claim 9, wherein one or more of the first surface lightsource and the second surface light source is controlled by the input.13. The apparatus of claim 9, wherein the hybrid image comprises thecombination of the reflected first light and the transmitted secondlight combined with one or more of a first surface light emanating fromthe first surface and a second surface light emanating from the secondsurface.
 14. The apparatus of claim 3, further comprising a soundemitter controlled by the input.
 15. The apparatus of claim 3, furthercomprising an output terminal configured to connect to auxiliary sourcesof one or more of light, sound, smell, physical movement, and materials,the auxiliary sources external to the apparatus, the output terminalconfigured to allow the input to control one or more of the auxiliarysources.
 16. The apparatus of claim 3, further comprising one or more ofa payment information reader and an identification information readerconfigured to read payment information and identification informationrespectively and control one or more of the first light source and thesecond light source based on one or more of the payment information andthe identification information.
 17. (canceled)
 18. (canceled)
 19. Amethod of creating a hybrid image, the method comprising: receiving aninput at an input terminal; controlling one or more of a first lightsource emitting a first light and a second light source emitting asecond light based on the input; producing a reflected first light by atleast partially reflecting the first light from a reflector; producing atransmitted second light by at least partially transmitting the secondlight through the reflector; and creating the hybrid image comprising acombination of the reflected first light and the transmitted secondlight, Wherein: the input terminal comprises a control screen; thereceiving the input comprises: displaying a user interface on thecontrol screen; and receiving a touch input at the control screen; andthe second light source comprises a first portion of a display and thecontrol screen comprises a second portion of the display.
 20. The methodof claim 19, further comprising: displaying one or more dynamic inputzones on the control screen, the dynamic input zones configured toreceive the touch input; and changing an appearance of at least one ofthe input zones in response to the touch input.
 21. The method of anyclaim 19, further comprising: sensing one or more of motion andproximity in the vicinity of one or more of the first light source, thesecond light source, and the reflector; and controlling one or more ofthe first light source and the second light source based on one or moreof the sensed motion and proximity.
 22. The method of claim 19, furthercomprising: one or more of: illuminating a first surface using a firstsurface light source, the first surface disposed at a first angle to thereflector; and illuminating a second surface using a second surfacelight source, the second surface disposed at a second angle to thereflector, the second angle different from the first angle; and whereinthe hybrid image comprises the combination of the reflected first lightand the transmitted second light combined with one or more of: a firstsurface light emanating from the first surface and transmitted throughthe reflector, and a second surface light emanating from the secondsurface and transmitted through the reflector.
 23. The method of claim22, further comprising: controlling one or more of the first surfacelight source and the second surface light source based on the input. 24.The method of claim 22, further comprising producing, using a soundemitter, one or more sounds based on the input.
 25. The method of claim24, further comprising synchronizing with each other two or more of thefirst light source, the second light source, the first surface lightsource, the second surface light source, and the sound emitter toproduce a hybrid presentation.
 26. The method of claim 19, wherein oneor more of the first light source and the second light source comprisesa display having a plurality of pixels; and the controlling comprisesselecting, based on the input, one or more of a given set of one or moreimages from a library of sets of images for being displayed by one ormore of the first light source and the second light source; and a givennumber of and given coordinates of the pixels of one or more of thefirst light source and the second light source for displaying the givenset of one or more images.
 27. The method of claim 19, furthercomprising controlling, based on the input, one or more auxiliarysources of one or more of light, sound, smell, physical movement, andmaterials.